PALEY-WIENER THEOREMS 
FOR THE U(n)-SPHERICAL TRANSFORM 
ON THE HEISENBERG GROUP 

FRANCESCA ASTENGO, BIANCA DI BLASIO, FULVIO RICCI 

Abstract. Wc prove several Paley-Wiener-type theorems related to the spherical trans- 
form on the Gelfand pair (i/„ x U(n), U(n)) , where i7„ is the 2?! + 1-dimensional Heisenberg 
group. 

Adopting the standard realization of the Gelfand speetrum as the Heisenberg fan in M^, we 
prove that spherical transforms of U(n)-invariant functions and distributions with compact 
support in _ff„ admit unique entire extensions to C^, and we find real- variable characteriza- 
tions of such transforms. Next, we characterize the inverse spherical transforms of compactly 
supported functions and distributions on the fan, giving analogous characterizations. 



1. Introduction 

The spherical transform for the Gelfand pair xi U(?7,), U(n)) maps U(?T,)-invariant 
functions, i.e. radial functions, on the Heisenberg group Hn to functions on the Heisenberg 
fan S, which is naturally realized as a closed subset of M^, the Heisenberg fan defined in 
(13 ■4p . In [HIS] we have studied the image of the space Sra.d{Hn) of radial Schwartz functions, 
showing that it consists of the restrictions to S of Schwartz functions on M^. 

In this paper we first use this result to extend the notion of spherical transform to tem- 
pered radial distributions, identifying such transforms as the distributions on which are 
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"synthetizable" on S, i.e., vanish on functions which are identically zero on the fan. Then 
we prove Paley- Wiener type theorems for the spherical transform Q and its inverse. 

The natural starting point for establishing Paley- Wiener theorems for Q is the fact that, 
when / has compact support, its spherical transform Qf can be extended from the set 
of bounded spherical functions (the Gelfand spectrum) to the set of all spherical functions. 
Spherical functions are parametrized by the pairs (^, A) G of their eigenvalues with respect 
to the two fundamental differential operators, L (the sublaplacian) and i~^T (the central 
derivative). Moreover, the spherical function a with eigenvalues (^, A) G depends 
holomorphically on (^, A). This allows to extend the spherical transform of a function or 
distribution with compact support to an entire function on C^. 

Symmetrically, each spherical function $g ^ extends to an entire function on the complex- 
ification of H^, and the inversion formula shows that if ^/ has compact support in the 
Gelfand spectrum, then the function itself extends to an entire function on H^. 

It does not look plausible to have a simple "complex variable" description of the entire 
functions which are in the range of the spherical, or inverse spherical, transform of the 
space of C°°-functions, or of distributions, with compact support, see also the comments in 
Fuhr [in], in a context that is closely related to ours. 

We rather look for analogues of the "real variable" characterization of the classical Paley- 
Wiener spaces in W^, in the spirit of the works of Bang [7] and Tuan [25], later expanded 
and refined by Andersen and deJeu [Tj. We take the following as our model statement [1]: 
a function / on R" is the Fourier transform of a function with compact support if and 
only if it is a Schwartz function and, for some p G [1, oo]. 



lim sup 

k—^oo 



AVI 



< oo 
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In this case, the left-hand side is finite for every p, the "hm sup" is a hmit and, for every 
P e [l,oo], 

hm ||A^'/||p = max |xp . 

When restricted to radial functions, this theorem can be reformulated in terms of the 
spherical transform Q for the Gelfand pair (M" xi SO„,SO„), given by Qf{\) = /(O with 
I^P = A > 0. Then we have two different statements, depending on the side of the Fourier 
transform it is applied on: 

(i) a function g on the Gelfand spectrum [0, +oo) is the spherical transform of a radial 
C°° function on R" with compact support if and only if it is a Schwartz function and, 
for some p G [1, oo], 

limsup llfi'^'^^llp < oo ; 

k—^oo 

in this case, for every p G [1, oo], 

lim ||5'''^'^||p = max . 

fc— >-oo x&uppg^^g 

(ii) a radial function / on is the inverse spherical transform of a C°° function with 
compact support in [0, +oo) if and only if it is a Schwartz function and fll.ip holds 
for some p G [1, C)o]; in this case, for every p G [1, C)o], 

lim II A''/ III = max A . 

k—^oo AGsuppC?/ 

We regard (i) as a Paley- Wiener theorem for the (direct) spherical transform, and (ii) as 
a Paley- Wiener theorem for the inverse spherical transform. 

Possible analogues of (i) and (ii) for the pair xi U(n), U(n)) rely on the identification, 
for each direction, of a differential operator on one side of the spherical transforms and the 
corresponding "norm" on the other side. 

Our results are related to the following choices: 
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(i') the difference /differential operators M± of Benson, Jenkins and Ratcliff [S] on S and 

the Koranyi norm (12.21) on Hn] 
(ii') the sublaplacian on Hn and its eigenvahie ,^ on S. 

We first prove real Paley- Wiener theorems for the direct spherical transform, i.e. analogues 
of (i) with the ingredients in (i'). We treat the cases of C°° and functions and of tempered 
distributions. These characterizations are summarized in Therorem 17. 1[ Corollary 17.71 and 
Theorem 17.81 

We also remark that the (unique) entire extension of the transform of a function in 
T^re,d{Hn) ueeds not be Schwartz on R^. This shows that, in general, the Schwartz extensions 
to constructed in [S] are different from the entire extension discussed here. 

In the second part of the paper, we show that, given a distribution U on with com- 
pact support , the inversion formula for the spherical transform produces a function on the 
Heisenberg group if„ ^ ]R^"+^ which can be analytically extended to C^"^^. If the distri- 
bution U is synthetizable on S, the function so obtained on Hn coincides with its inverse 
spherical transform. For such distributions t/, we obtain a real Paley- Wiener analogue of (ii) 
with the ingredients in (ii'). A similar theorem is also proved for functions on S which are 
either restrictions of C°° functions or are square integrable with respect to the Plancherel 
measure. Our characterizations are summarized in Therorem 18.41 Theorem 18.71 and Theo- 
rem [831 These results can be interpreted as a "real" spectral Paley- Wiener theorems for the 
spectral measure of the sublaplacian, a point of view which coincides with that of |16j . 

There is a wide literature on Paley-Wiener theorems on the Heisenberg group. The 
earliest result is due to Ando [2] , followed by Thangavelu [211 ESI [23] , Arnal and Ludwig [3] , 
Narayanan and Thangavelu [TH]. Results are mostly related to the group (operator- valued) 
Fourier transform and its inverse, but there are also "spectral" Paley-Wiener theorems, as in 
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the already mentioned paper [TB] , where the condition of compact support on the transform 
of a given function is replaced by the condition that the function itself belongs to the image 
of the spectral measure of a compact set in M"*" associated to the sublaplacian (see also 
Strichartz [2U], Bray [TU], and Dann and Olafsson [12] in other contexts). 

Our paper is organized as follows. In Section 2 we introduce the basic notation. In Sec- 
tion 3 we treat spherical functions noting that they can be extended to holomorphic functions 
in each variable and providing some easy estimates. Section 4 and Section 5 deal with the 
spherical transform of radial functions and radial tempered distributions, respectively. In 
Section 6 we prove some properties of the operators M± first introduced in [S]. These are ex- 
ploited in Sections 7 and 8 to obtain real Paley- Wiener theorems for the spherical transform 
and its inverse, respectively. 

2. Notation 

We denote by Hn the Heisenberg group, i.e., the real manifold C" x M equipped with the 
group law 

{z,t){w,u)= [z + w,t + u+\lm{w\z)) ^z,weC"-, t,ueR, 

where (-I-) denotes the Hermitian innner product in C". 

It is easy to check that the Lebesgue measure dm = dz dt is a Haar measure on Hn. 

We denote by T, Zj and Zj, where j = 1, . . . ,n, the left-invariant vector fields 

Zj = d,^-lz,dt Z, = d,^ + lz,dt, T = dt. 

The only nontrivial brackets are T = —2i [Zj., Zj]. 

The operators Zj and Zj are homogeneous of degree 1 while T is homogeneous of degree 2 
with respect to the anisotropic dilations r ■ {z,t) = {rz,r'^t), where r > and {z,t) G Hn- 
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Let / = (zi, . . . , Z2n+i) be in N^n+i. denote by a differential operator of homogeneous 
degree deg I = ii + ■ ■ ■ + i2n + 2i2n+i of the form 



The monomials with deg I = j form a basis of the space of all left-invariant differential 
operators on iJ„ which are homogeneous of degree j. 

We write S{Hn) for the Schwartz space of functions on Hn, i.e., the space of infinitely 
different iable functions / on Hn such that all partial derivatives f of / are rapidly de- 
creasing. The Schwartz space is equipped with the following family of norms, parametrized 
by a nonnegative integer p: 



(2.1) 



D 




sup {{l + \{z,t)\Y\D'f{z,t)\ : deg/<p} 



{z,t)eH, 



where 



(2.2) 




We also define A as 




so that \A{z,t)\ = \ {z,t)\'^. 



3. Spherical functions 



The unitary group U(n) acts on Hn via 



k ■ {z, t) = {kz, t) 



W{z,t)eHn, ke\J{n). 



This action induces an action on functions / on Hn by the formula 



k-f{z,t) = fik-'z,t) 



\/ke\J{n), {z,t)eHn. 
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We note that a function / on is U(?7,) -invariant if and only if it depends only on \z\ 
and t , therefore we shall call it radial. We denote by S^s.d{Hn) the space of radial Schwartz 
functions. 

Denote by G the semidirect product iJ„ xi \]{n). We may identify the space of smooth 
bi-U(n)-invariant functions V{G//l]{n)) with the algebra Drad(-ffn) of smooth radial func- 
tions on Hn with compact support. It is known [T71 [TT] that (G, U(n)) is a Gelfand pair, 
i.e., Prad(-f^n) IS a commutative algebra. We may also identify the commutative algebra 
D(G/U(n)) of G-invariant differential operators on G/l]{n) with the algebra Drad of all 
left-invariant and U(n)-invariant differential operators on Hn, which has two essentially 
self-adjoint generators, namely i~^T and the sublaplacian 



The spherical functions are characterized as the joint eigenfunctions of all G-invariant 
differential operators on G/l]{n), i.e., as the radial eigenfunctions of i~^T and L, normalized 
to take value 1 at identity. Spherical functions are analytic and are uniquely determined by 
the pair of their eigenvalues relative to L and i~^T respectively. 

The next subsection shows that the spherical function exists for every pair [C,, A) of 
eigenvalues and that depends holomorphically on variables and parameters. 

3.1. Holomorphy of spherical functions. We initially consider real eigenvalues ^ and A 
and look for a radial solution of the system 



n 



Lu 



(3.1) 



< Tu 



iX u 



^ u(0,0) = 1 . 
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Following [IB], for A 7^ we write the solution in the form 



obtaining that v satisfies the confluent hypergeometric differential equation 
(3.2) s v'\s) + (c - s)v\s) - a v{s) = 

with parameters a = ^ — j^, c = n. The normalized solution of fl3.2p is the confluent 
hypergeometric function 



where (a)o = 1, {a)k = r(a + k)/T{a), so that for real A 7^ 



When A = and ^ is real, a similar procedure shows that 

u{z,t) = izll! = Jn-i(ekr/4) V(z,t) e H^, 



(n)h k\ 
k=o ^ ''^ 



where 

+00 



+ 00 / X ^ 



fc=0 



(u/2)^ 

Note that Jjiiu) = — — — ^7/3 (^^/4) is the Bessel function of the first kind of order (3. 
Therefore for every pair of real numbers ^ and A we have the spherical function 



J-„_i(eklV4) A = 

We now verify that A 1 — > ^^^x{z,t) is regular in A = 0. Indeed, something more holds. 
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Lemma 3.1. The function {x,y,t,^,X) i — y ^^ x{x + iy,t) extends to a holomorphic function 
on C2"+^ 



Proof. Note that when \ 0, z = x + iy, 

fc=l ^ d=0 

so that for all A, x, y, t) the function 

(oo / 2 I 2\k \ 
1 + E (I), fc! 4. n(A(2rf + n)-0j 

is a series of entire functions converging uniformly on compact sets. □ 

By analytic continuation, is the spherical function for every A) G C^. 

3.2. Bounded spherical functions. The Gelfand spectrum of the Banach algebra Ll^^{Hn) 
of radial integrable functions is given by the set of normalized bounded spherical functions, 
equipped with the compact open topology. We recall [18] that $5,a is bounded on Hn if and 
only if A) belongs to the so called Heisenberg fan given by 

(3.4) S = S* U {(^,0) G : e > 0} , 

where 

S* = {(e,A)GM2:A^0,e = |A|(2j+n), j G N} . 

It is known that S is homeomorphic to the Gelfand spectrum [HI [9]. 

When (.^, A) is in S*, the spherical function a can be written in terms of Laguerre 
polynomials, which is the form that we usually find in literature. Indeed, the relation (see 
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da p. 253, formula (7)] 

(3.5) iFi{a, n; x) = iFi{n — a, n; —x), 

implies that 

and when ^ = |A|(2j + n) the hypergeo metric function in the previous formula coincides with 
the normalized j^^ Laguerre polynomial of order n — 1, i.e., 

3.3. Estimates of derivatives of spherical functions. In this subsection we exploit 
the fact that the bounded spherical functions {'^'5,a}(^ averages of coefficients of 

irreducible unitary representations of to give some estimates that we shall need in the 
sequel. Referring to the Bargmann-Fock model of the irreducible representations vr^ of 
Hn associated to the character e^^^ on the center, we represent the operators 7T^{z,t) as 
matrices (^j*k(^; ^))j ^gN" basis of normalized monomials (for more details see the 

monographs [15] or [21]). Then the bounded spherical functions can be written as averages 
of diagonal entries of this matrix according to the rule 

(3-6) '^C,A = 7jqi:TYE^J' 

^ i ^ |j|=j 

where C = |A|(2j + n) and |j| = ji + . . . + jn for j = (ji, . . . , j„) e N". 

Lemma 3.2. Let he a differential operator of homogeneous degree degJ = a as in h2.1\) . 

Then 

|^'$€,A(^,t)| <a(l + 0"/' V(e,A)eS, {z,t)eHr,. 
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Proof. Let A 7^ 0. Here and afterwards, if any component of the multiindeces j or k is 
negative, then ir^^ = 0. Since the representations are unitary, Ivrj^j^l < 1 and it is easy to 
check that 



^ . . v '^"^-- A>0 I V^-^UH-e, A>0 



^-^.e. A<0 [-V^-^._e, A<0 

and Tn^^ = i X n^y Here ej is the multiindex with just the i*'* component equal to 1. 

Suppose that (^, A) is in S*, with ^ = |A|(2|j| + n). Then if = Z^Z^T' with degJ 
a = |k| + |h| + 2s we have 



lA 



s 



uti nti + ^) Jut, nil Kj. + + 1 - ^) k^j+h-^i a > o 



nr=i uti ^(j. + 1 - ^) Jut, uti ^(j. - + ^) i^-h+ki A < 



< C |A|^ y'lAjlhl+lkldjl + |h|)|h| (|j| + |h| + |k|)W 

<c,(i + 0"/'. 

Here we have used the fact that in S* we have ^ = |A|(2|j| + n) > |A|. By f l3.6p the thesis 
follows on S*, and by continuity the same estimates hold on S, thus proving the lemma. □ 

4. Spherical transform 
As usual, we denote by (■,■)//„ the dual pairing on Hn and we shall also write 

{f,g)H„= [ f{z,t)g{z,t)dzdt, \/f,geS{H^). 

Given a measurable function / on Hn we denote by / the function defined by f{x) = f{x^^) 
for every x in Hn- 



12 F. ASTENGO, B. DI BLASIO, F. RICCI 

4.1. Definitions and main facts. Let / be in L].^^{Hn)- We define its splierical trans- 
form Qfhj 

Qf{iA)= I /(x)$5,,(x-^)rfx=(/,$5,,)H„ V(e,A)GS. 

J H„ 

Tfien ^/ is a continuous function on E. 

Tlie inversion formula for a function / in Srs,d{Hn) is 

fix) = [ gf{^, X) $5,A(a;) dfi{^, X) Va; G H^,, 

wliere /x is tlie Plancfierel measure defined by 




V^(|A|(2j + n),A) |A|"rfA G 



It is easy to clieck tliat tlie function (.^, A) t-)- (1 + ^) is in L^iTj)-, so 

(4.1) U\Wi^) < C 11(1 + |e|)"+V||L-(R^) vv; G 5(M2). 

As in |3], we denote by iS(S) the space of restrictions to S of Schwartz functions on M^, 
endowed with the quotient topology iS(]R^)/ {(j) : 0|e = 0}. For radial Schwartz functions on 
we have proved the following result. 

Theorem 4.1. [Tj Corollary 1.2] The spherical transform is a topological isomorphism be- 
tween the spaces S^i,d{Hn) and 5(S). 

On the other hand, Lemma [3.11 implies that when / is compactly supported we can regard 
^/ as a function on C^. 

Proposition 4.2. // / is in Prad(-f^n) then Qf extends to the holomorphic function F on 
€?■ given by the rule 

A) = (/, ^^,,)h„ V(e, A) G 



PALEY-WIENER THEOREMS ON THE HEISENBERG GROUP 



13 



4.2. Holomorphic versus Schwartz extensions. Given / in Pj.ad(-f^n); we liave found 
two ways of extending its spherical transform Qf to a. smooth function on M^. Namely, 
by Theorem 14. ![ there exists a Schwartz function G on such that G\j] = Qf, and by 
Proposition l4.2l the function F is the holomorphic extension of ^/ to C^. So G|s = -F|e = ^Z- 

We observe that any two entire functions on C^, which coincide on S, are everywhere 
equal, so F is the unique continuation of ^/ to an entire function on C^. 

A question arises naturally: if / is in "Dradl-f^n); is it true that F, when restricted to real 
values of (^, A), is a Schwartz function on M^? 

In the rest of this subsection we show that the answer can be negative. 

Let / be a function of the form 



where h is even and compactly supported and g is nonpositive and supported in 1 < \z\ < 4, 
equal to —1 when 2 < \z\ < 3. 

Let J^h be the Euclidean Fourier transform of h. We now show that the function A > t— ?■ 
\J-'h{\) \ e'^/^ is not bounded. Indeed, since h is even, if it were bounded, then for every b, 
< 6 < 1/2, the function A i-> e^l'^' J'/i(A) would be in L^(]R). By the Paley-Wiener Theorem 
for the Euclidean transform h = J^^h would continue analytically to {w : |Im(w)| < 1/2}, 
but this cannot be true since h has compact support. Therefore the function A > t— 
\J^h{X) \ e^/^ is not bounded. 

Now, if (^, A) G H- F{C,, A) were rapidly decreasing, then the same would hold true for 
the function A t— F{{n + 1)A, A). Note that when A > 



f{z,t)=g{z)®h{t) 



V(z, t) e H, 



n 




n,X\z\^/2)dz. 
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Moreover iFi{—^, n,x) < when x >2n and by the estimate (see [121 p. 27, formula (3)]) 
T(n) 

iFi(a,n;a;) = -V4e'=a:''-"(1 + 0(a;-M), Re(x)^oo, 7^0,-1,-2,..., 
r(a) 

when A — !■ +00 we obtain 

|F((n + l)A,A)| = |J^/i(A)| / (7(^)e"^l^l'/SFi(-i,n,A|2|V2)rfz 

Jl<\z\<A 

>C\Th{X)\ [ e-"l^l'/^e^l^l'/2(A|^|V2)-i/2-n^^ 
> C|^/i(A)|e^/2^ 
so the function A H- F{{n + 1)A, A) is not bounded. 

5. The spherical transform of radial tempered distributions 
As usual, we denote by (■, ■)m2 the dual pairing on and we also write 

Let n : S{Hn) — > <S{Hn) be the averaging projector defined by 

n/= / fokdk yfeS{Hn). 

Jv(n) 

Then the Schwartz space on if„ decomposes into the direct sum S{Hn) = Sj-adiHn) © ker 11 
so that Sj-a^diHn) is isomorphic to the quotient space S{Hn) / keiU. It follows that the dual 
space (iSrad(-ffn))' is isomorphic to the subspace S'j.^^{Hn) of S'{Hn) consisting of all tempered 
distributions A on such that 



(A,/)^,„ = V/ekern. 
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On the other hand the dual space of is naturally isomorphic to the subspace i5q(S) of 
iS'(M^) consisting of all tempered distributions U on such that 



{U, g)R2 = , e 5(M^) such that ^ = on S . 



We note that the Plancherel formula can be written as 



Therefore we are led to define the spherical transform of a radial tempered distribution A 
on Hn as the distribution QA in 5'(]R^) given by 



Clearly, if A is in S'^^^(Hn), then for every function ip in iS(M^) such that ip = on H we 
have (^A, (p)^2 = (A, (^^ V|e) )Hn = 0? i-^-j is in Sq(T,). We recall that we have denoted 
by m the Lebesgue measure on Hn. If / is a radial function in fl L'^{Hn), then fm is in 
and Q{fm) = {Qf) where Qf has been defined in Subsection 14. 1[ so formula (15. 1|) 
provides an extension of the usual spherical transform. 

Moreover it is easy to verify that Q{L^A) = ^-^ QA for every A in S^^^{Hn). 

With this notation Theorem 14.11 extends to radial tempered distributions in the following 
form. 

Corollary 5.1. The spherical transform Q is a topological isomorphism between the spaces 



We now study the behavior of the spherical transform of radial compactly supported 
distributions. 



(5.1) 



{gA,ip)^2 = {A,{g-'^\j)H, 



SUHn) andS'.iT.). 
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Proposition 5.2. Let A be a radial compactly supported distribution on H^- Then 

(5.2) A : (e,A)^(A,<l>5,A)H„ 

is a holomorphic function on C^. Moreover K ^ is in Sq{T?) and 

gA = Afi, 

i.e., QA coincides with the function A. 

Proof. Using Lemma [3.11 it is easy to prove that A is entire. For the second part, we first 
check that for every tp in i5(M^), the integral Jj,At/jdjj is absolutely convergent, and therefore 
A is in iSo(S). Indeed, if (^, A) = (|A|(2j + n). A) is in S*, for some m in N 

|A(e,A)| = |(A,$^,,)Hj<C||<l>^,,||^^(^), 



where K = suppA C S. By Lemma f3.2[ the function A is slowly growing on S and so for 
every tjj in the integral Jj.Aijjd^ is absolutely convergent. 

When g is in ^(M^), 



(A/i,^)K2 = / A(e,A)^(e,A)c//i 

1 / / J + ~ 1 



/ Ef^"^"" ^)A{\X\{2j + n),X)ij{\X\{2j + n),X)\XrdX 

JR ,_n \ 3 / 



j=0 



(27r)'^+i 

i^L(2^ L^^y J )A(|A|(2,+n),A)V^(|A|(2, + n),A)|ArrfA 

L^V J j(A'^l^l(2.W^"^(l^l(2j + -).A)|ArrfA 

(^'/l^ (^+"~') Wn),A^(|A|(2j + r.),A)|ArdA' 



J=o ^ ^ / 
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Since 

uniformly on compacta and the same holds for all derivatives, 

6. The operators M± 
Denote by M± the operators acting on a smooth function ip on by the rule [S] 

M±V(e, A) = dxH^, A) T nd^ij{^, A) - 2(nA ± / ± 2At, A)(l - t) dt. 

Jo 

= I (A9a + ^d^) H^,X)- {H^ ± 2A, A) - ^(e, A)) . 

Since Xd\ + C,d^ is the derivative in the radial direction, the operators M± depend only on 
the restriction to the Heisenberg fan. 

The operators M± have the following relevant property. If / is radial and (1 + .4.)/ is 
integrable on Hn then (see [S]) 

(6.1) giAf) = M4gf) and giAf) = -M4Qf)- 

One can verify that 

{M+{gf)fi, gh)^2 = -{{gf)fi, M_{gh))^. v/, h e s.^Hu). 

Hence by Theorem 14.11 



(6.2) 



Jt, is 
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According to (16. 2p . when U is in i5q(S) we define the distribution M^U by 

and similarly we define M_U with M+ and M_ interchanged. 
Clearly ii = then {M_^Ij)\^ = 0, so that M+U is in 
Moreover it is easy to verify that (16.11) extends to distributions, i.e. 

(6.3) ^(^A) = M+{gA) and ^(^A) = -M_(^A) VA G S'{Hn). 

Finally, given a distribution in iSq(S) of the form Ffi, where F is smooth and slowly growing 
on M?, we note that for all in 5(R^), 

{M+{Ffi),i:)u2 = -{Ffi,M_ij)^2 

FM_'4)dn 
= ^M+F^rf/i= ((M+F)/i,^)M2, 

therefore 

(6.4) M+(F^) = (M+F)/i. 
For later use, we prove the following estimate. 

Lemma 6.1. Let a he a positive integer, then for every tp in ©(R^) with support in the set 

{(e,A)GR2 : iei<p} 

2a 
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Proof. It is enough to prove the statement for M_|_, since M_ip = — [M^ip] , where ipi^, A) = 
ipl^, — A). Let W denote the operator acting on a smooth function tp on by 

Wi:{i,\) = 2 [ dli!{i + 2\t,\){l-t)dt. 
Jo 

For every j > let rjj be the function and let Vj be the operator defined by 

riM, A) = ^ + (2j + n)X V, = dx - (2j + n)d^. 

With this notation M+ = Vq — r]oW. Moreover, as proved in [6l Lemma 4.5], for every 
positive integer a, 

a 

(6.5) M^ = Vo^ + J2m--- r]k-i Dk,a. 

k=l 

where Dk^a is a polynomial in Vq, . . . ,Vk,W of degree a such that in each monomial the 
operator W appears k times. 

Let ip be in 'D(M^) with support in the set {{C,, A) G : |,^| < p}. Then it is easy to see 
that supp Dk,aip C {(^, A) e : 1^1 < cp}, with c depending on a. Therefore, using (14.11) . 

a 

IIM^V^IIlI(S) < |IWIUi(E)+$^ho---%-lI^fc,aV^||Li(S) 

fc=l 

\r+s<a k=l / 

We complete the proof by showing that 

\\Dk,a1p\\L^{R^) < da ^ || 9^9^^ || ^oo (^2) /c = 1, 2, . . . , O, 

s+r<2a 

by induction on a. Indeed, the case a = 1 is trivial since 

||Vr^||L-{R2) < 2 / ||9|V^|Uco(K2)(l -t)dt<C ||9|V^|Uoo(K2). 



20 F. ASTENGO, B. DI BLASIO, F. RICCI 

If a > 1 then either D^ a = -D/t_i,a-i or Z^^ „ = D^ a-i Vj, for some j and k < a — 1. The 
second case is trivial. If D^ a = -D^-i^a-i W, we note that by induction on s it is easy to 
verify that 

dld^Wij = 2 ^ (^^^ ^ gs-kQr+2+k ^ 2Xt, A) (2t)'^ (1 - t) dt. 

Therefore 

||L>fc_l,a-ll^^/'|U-(M2) < C'a \\dldlWtlj\\L^(M.2) 

s+r<2a-2 

s 

s+r<2a-2 k=0 

<Ca Y I|5a5[^IU-{M2)- □ 

s+r<2a 



7. Real Paley- Wiener results for the spherical transform 

Suppose that A is a radial tempered distribution on Motivated by P, we define -R(A) 
in [0, oo] by 

_R(A) = max{|x| : x G supp A} 

and we call -R(A) the radius of the support of the distribution A. 

The purpose of this section is to prove real Paley-Wiener Theorems for the spherical 
transform; we start with a characterization of compactly supported radial distributions and 
then we specialize these results to square integrable radial functions and Schwartz radial 
functions. When a distribution U on M? is of the form U = Fjj fi with Fjj a (smooth) 
function on M^, by abuse of notation we shall also denote by U the associated function Fu. 

Our first characterization reads as follows. 

Theorem 7.1. Let A be in S'j.^^{Hn)- The following conditions are equivalent. 
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(1) R{A) IS finite; 

(2) QA is the restriction to T, of a smooth function on and for every p in [1, oo] there 
exists (3 > such that 



limsup 11(1 + 0"'' M|6;A||^//(^) < oo; 



(3) for every large j the distribution M^_^QA is the restriction to of a smooth function 
on and there exist (3 > and p in [1, oo] such that 

lim inf 11(1 + 0"^ Mi^A||i//( <oo. 

Moreover, if any of these conditions is satisfied, then for every p in [1, oo] there exists (3 > 
such that 

(7.1) lim||(l + 0-^M|^A||i//( =/?(A)l 

Since M_?/^ = — [M+t/;] , where ipi^, A) = — A), we have also a corresponding ana- 
logue with M_ in place of M_|_. 

The proof of Theorem 17.11 is given after some preliminary results, the first of which is the 
following technical lemma. 

Lemma 7.2. Let R> and j be a positive integer. Suppose that f is a smooth function on 
Hn with compact support in the set {x G Hn ■ \x\ > R} and let fj = A^^ f ■ 
Then for every N in N 

m + 0''GfAL-(^)<CNf''R-'^ max 

fc+deg J=2/i 

Proof. Note that since / is supported away from the origin, the function fj = f is again 
smooth and compactly supported. Moreover, 

11(1 + 0"^ ^/.IIl-(s) = \\Q{{i + Lff^) 
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<||(/ + L)^/,|Ui(^,„). 
Clearly (J + L)^ fj = ^ {^^)L''fj and by the Leibniz rule 



dog /+dcg J=2h 

< max J^'IIM"^-'^^') P'/)IUhh.o 

dog /+dcg J=2h 

dcg /+dcg J=2h 

Now we note that the spherical transform of radial compactly supported distributions 
satisfies a pointwise estimate on the Heisenberg fan S. 

Proposition 7.3. Let A be a radial compactly supported distribution of order N on Hn- 
Then for every R > R{A) there exists a constant C = Cr > such that for every j in N 

(7.2) |M|A(e,A)| <Ci?2i(i + ^)A^/2 V(e,A)GS. 

Proof. We have already proved in Proposition 15.21 that QA = Aji and that A extends to an 
entire function, so A is in C°°(S). Moreover by equations (16.31) and (16. 4p 

(MiA)/i = Mi(A^) = M{gA = g{A^A) = AJA fi, 

therefore M^A = A^A. 

Let R > R{A) and choose Ri such that R > Ri > R{A). Suppose that g is a radial test 
function on Hn such that g{x) = 1 when x is in the support of A and (^(x) = if |x| > 
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Then for all A) in S*, 

|MiA(e,A)| = |i^(e,A)| = |^(e,A)| 

<C \\D'igA^<l>i,-,)\\L^iH^y 

deg I<N 

We conclude by the Leibniz rule and Lemma 13.21 that 

|MiA(e, A) I < C (1 + Rl' (1 + 0^/' V(e, A) e E*, 
which, since R > Ri and by the smoothness of A, implies (17.21) . □ 



Conversely, it is easy to deduce that a radial tempered distribution is compactly supported 
when a certain limit is finite. 

Proposition 7.4. Let A be in S^^^{Hn). Suppose that there exists J inN such that for every 
j > J the distribution M:J_^A is of the form Gj fi, where Gj is a locally integrable function 
with respect to f^i. Then for every N in N and every p in [1, oo] 

hminfll (1+0-^ CU>RiAr. 

Proof. Suppose that -R(A) > and let < e < i?(A)/2. Then we may find a smooth function 
/ with compact support in the set 



{x e Hn : i?(A) -e <\x\ < R{A) + e} 
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such that (A, 7^ 0. As in the previous lemma, the function / is supported away from 
the origin and we let fj = A^'-' f. By (15. ip and (16.31) 

|(A,/)^J = \{A,A^A-^f)Hj = \{A,A^f,)Hj 
= \{A^AJ,)Hj = \{g{A^A),gf,M 

= \{MigA,gf,)^. \ = \ {G, fi,gf,)^2\ 



(S)- 



In the case where ||(1 + ^) 6*^11^^(2) = 00 for all j, there is nothing to prove. Otherwise, 
since |(A,/)hJ ^0, 

hminf 11(1 + 0"^ >liminf ( tttt^^^^, ] = Hminf ||(l + 0^^/,||-;4. 

Since there exists M in N such that ^ n- (1 -|-^)^-*'^ is in L^'(S), by Lemma [7l2] we conclude 
that 

11(1 + 0^^/.IIl.'(e)< 11(1 + 11(1 + 0^^/.IU»(E) 

and the thesis follows easily. 

When -R(A) = 00 we use the same arguments to show that lim inf ||(1 + ^)~-^ Gj\\ ip^v^-, > R 
for every R > 0. □ 

Putting together Proposition 17.31 and Proposition 17.4^ we obtain the following criterion, by 
which we can measure the size of the support of a radial compactly supported distribution. 

Corollary 7.5. Let A be a radial compactly supported distribution of order N. Then 

^hm l|(l+0-^/^MiA||^/i(^) = /?(A)2. 
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Proof. From the pointwise estimate f l7.2p . we deduce that for every R > R{A) 

hmsup||(l + 0"^/'AfiA||^/i(^) </22, 
therefore hmsup ||(1 + 0"^^^ ^IMIl^is) ^ The thesis follows by Proposition m 



lL°°(E) 



□ 



Proof of Theorem 7.1. If A is compactly supported and of order then by Proposition 15.21 it 
coincides with a smooth slowly growing function G on M^. If > o is such that (1 + ^)^/2-/3 
is in we have 

(7.3) \\il + 0-^MiGh.i^) < + + 



Hence by Corollary 17.51 we have that (1) =^ (2). The implication (2) =^ (3) is trivial and 
the implication (3) =^ (1) is a consequence of Proposition 17.41 Finally (17. ip follows by (I7.3p . 
Proposition 17.41 and Corollary 17.51 □ 

7.1. Square-integrable functions. 

Theorem 7.6. Suppose that for every j > the function M^^ip is in L^(S). Then the 
function f such that Qf = ip is in L'^{Hn)and 

hm llMiV' \\1l^, = RUf- 



Proof. By Proposition 17.41 it is enough to check that limsupj_^oo ||M:['0||^{f|.j.^ < R{fY, and 
this is easily established by using the Plancherel formula. Indeed, when R{f) is finite, 

Corollary 7.7. Let R > 0. Then Q is a bijection from the space L'l^^^{Hn) of square 
integrable radial functions f such that R{f) < R onto {tp G L'^{^) '■ limj_>.oo || M-^ip W]^^^,-^ < 
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7.2. Schwartz functions. The purpose of this subsection is to prove the following charac- 
terization. 



Theorem 7.8. Let f be in 5rad(-f^n)- The following conditions are equivalent. 

(1) R{f) is finite; 

(2) for every h>0 and every p in [1, oo], limsup^-^j^ || C,^ M-^Qf is finite; 

(3) there exists p in [1, oo] such that liminfj^oo || Mi_Qf \\]^J(^^^ is finite. 

Moreover, if any of these conditions is satisfied, then for every h >0 and every p in [1, oo], 

hm II {i + O^M^gf ||i//( =i?(/)^ 

Note that the implication (2) =^ (3) is trivial, and that (3) =^ (1) follows from Proposi- 
tion [731 In the next proposition we prove the implication (1) =^ (2). 

Proposition 7.9. Suppose that f is a radial Schwartz function on Hn. Then for every h > 
and every p in [1, oo] 

hmsupll {1 + 0'Migf C\^^<R{ff. 

Proof. If R{f) = oo there is nothing to prove. If R{f) = 0, then / = and the conclusion 
is again trivial. We therefore suppose that R{f) is positive. Note that 

eMigfix,o = g{L'A^f) 

and when j > 2h, by the Leibniz rule 

deg 7+dcg J=2h 
deg 7+deg J=2h 



L^A^f\ = 
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Therefore 



' deg J=2h—q 
q<2h 

q<2h 

We note that for a sufficiently big integer M the function (A, t— )■ (1 + is in -Z^^(S), 
so that 

II (1 + 0' Mi^/ iup(s) < c II (1 + 0""+" Mi^/ lu^(s) 

and taking the j-th root, the desired inequahty foUows. □ 

Corollary 7.10. Suppose that f is a radial Schwartz function on Hn and let 1 < p < oo. 

Then for every h inN 

hm II {i+o'MiGf =R{fr. 

Proof. Since ||(1 + 0^ ^+^/IUp(s) ^ || M^^Qf IIlj^cs), by Proposition 17.41 we obtain 



liminf||(l + 0'Mi^/ ||^//(^) >liminf||M|^/ \\%^>R{ff. 



The thesis follows from Proposition 17.91 □ 
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8. Paley-Wiener theorems for the inverse spherical transform 

In this section we describe the inverse spherical transform of compactly supported distri- 
butions in iSq(S). 

Given a compactly supported distribution in 5'(M^), we define the function /(/ on the 
Heisenberg group by 

An easy consequence of Lemma 13.11 is the following. 

Lemma 8.1. Let U be a compactly supported distribution in S'^R"^). Then the function 

{x,y,t) H-^ fu{x + iy,t) = (f/, + zy, t))K2 

extends to a holomorphic function on C^""^-*^ . 
If f/ is in 5'(M2), define 

p([/) =max{|e| : (e, A) G supp [/} , 

so that a distribution U in Sq{T?) is compactly supported if and only if p{U) is finite. 

In the next proposition we prove that if t/ is a compactly supported distribution in i5g(S) 
then the function fu is a slowly growing function on Hn and it coincides with the inverse 
spherical transform of U . 

Proposition 8.2. Let U be a compactly supported distribution in Sq(T,) and let, as before, 



fuiz,t) = ([/,$(.) (2;, t))K2 \/{z,t) e Hn. 
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Then U = Q{fu "t.) and fu is a slowly growing function on Hn together with all its derivatives. 
Moreover, for every p > p{U) there exist C = Cp and M such that for all j > 



.1) \L^fu{z,t)\ < C(l + j)V (1 + 1(^,^)1)"" V(z,t) G 



where k is the order of U. 

Remark 8.3. Observe that if ?7 is a distribution in iS'(]R^) with compact support in S, then 
the function fu may not be slowly growing. Indeed let U = d^6(^n,i) where 5(n,i) is the Dirac 
measure at the point (n, 1) in S. Then, reasoning as in Lemma [3.11 when {z,t) is in Hn 



it -\z\y4 °° (\z\'^/2)^ 

k=l ^ 



Since k < k + n and (n)h. < (n + k — l)\ we obtain when 1 2; I is large 



\fu{z,t)\> — - — 2^ 



2 ^ {n + k)\ 2(|2|72)'^' 

This is due, much as in Subsection 14. 2[ to the fact that the holomorphic extension of spherical 
functions does not satisfy good estimates away from the Heisenberg fan. The main point 
in the proof of Proposition 18.21 is that, according to formula f l8.2p . if U is in Sq{T,) one is 
allowed to choose a different extension. 
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Proof. By Theorem 15.11 there exists A in S'^^^{Hn) such that Qh. = U. Let g be in V{Hn 
then 

{fu,g)Hr,= fu{z,t) g{z,t)dzdt 



([/,$(.) (2;, t))M2 g{z,t)dzdt 
[u, J ^(.){z,t) g{z,t) dzdtj 
= {U, Qg)9? 

Hence the distribution A coincides with the function fu, which is smooth. 

We first prove the estimate fl8.ll) . Fix {z,t) in Hn. Let k be the order of U, let p > p{U) 
and denote by Bp the ball of radius p in M^. Then for every j > 

\Ufu{z,t)\ = = |(f/,e<f(.)(^,^)W| 

(8.2) < Cinf {||e^^'1c^(B,) : e ^^(M^), (p^'*,^^^^ = <f(.)(^,t)} 

In order to obtain the desired estimate we shall choose a suitable extension ip^'*' of $(.) {z, t). 

Let ip he a smooth function on with compact support such that tp\Bp = 1- By Theo- 
rem |4]T] there exists u in iSrad(-f^n) such that Qu = If i^(z,t) denotes the measure defined 
by 



/ g{w,s)du(^z^t){w,s) = g{kz,t)dk \/g e C^Hn) 

Jh„ Ju{n) 

then for every (,^, A) in fl S 



t) = gi>i.,t){^, A) = A) ^(e, \) = g * u) (e, A). 
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^z,t ■ Q/Tn>2\ 
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Since i^{z,t) *u belongs to Sj-i^^{Hn), then by Theorem 14. II there exist tp^''^ in iS(M ) and M > 
such that 



and 



Moreover 



f'llCiBp) < C \\iy(z,t) *U\\iM)- 



<^^'*(e,A) = %;,)(z,t) V(e,A)Gi?,nE. 
If T(^uj,s)u{w' , s') = s)^^{w', s')) denotes the left translation, then 



Wc'iBp) < C \\l^{z,t) *'"||(A/) 



c 



Hn 



{M) 



\mw,s)U\\iM)dl^{z,t){w,s) 

J Hn 

<C f (1 + \w\^ + s^/^ du^z^t){w, s 



C{l + \{z,t)\) 



Therefore there exists M such that for all j > 



M 



\L^Mz,t)\ <C{l+j)'p^ (1 + \{z,t)\Y' \f{z,t) e iJ„. 

The proof above can be adapted to prove that for every differential operator of the 
form (12. ip there exists M > such that 

\D'fuiz,t)\ < C(l + \iz,t)\y' \/{z,t) e H^. 

Indeed, note that 



D'fu{z,t) = {U,D'^^.){z,t)), 
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therefore 

Fix {z,t) in Hn and consider the distribution Dj^^ _i_^U(^z,t) defined by the rule 

Then D]^^^-^V{^z,t) is a radial distribution supported in the orbit of {z^t), hence it has compact 
support. So, for ip and u as above, ^jZ>(^^t) * n is in Sradi^Hn) and by [H Proposition 3.2] 
there exists (/J^'*'-'^ in C''(M^) and M such that 

Since Qui^^^^ = ^pi^^^^ = 1, 

A) = * A) = g{Dl,)i>(z,t)m A) V(e, A) G S n 5^, 

and by Proposition 15.21 

Finally, reasoning as before, 

llv^^'^'IcHB,) < c||Df,,,)i>(,,i) < c(i + \{z,t)\)'' y{z,t) G H^. a 

Our characterization of the inverse spherical transform of compactly supported distribu- 
tions is the following. 

Theorem 8.4. Let U he in 5q(S). The following conditions are equivalent. 
(1) p{U) is finite; 
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(2) Q^^U coincides with a smooth slowly growing function function on Hn and for every 
p in [1, oo] there exists /3 > such that 

limsupll {l + A)-n^g-'U < oo; 

(3) for every large j the distribution UQ~^U coincides with a measurable function on 
and there exist /3 > and p in [1, oo] such that 

liminf II {l + A)-^Ug-^U , < oo. 

Moreover, if any of these conditions is satisfied, then Q^^U is a smooth slowly growing 
function on Hn and for every p in [1, oo] there exists /3 > such that 

(8.3) lim II (1 + A)-^ Ug-'U W'li = p{U). 

As in the previous section, we split the proof of our characterization into several parts. 

Proposition 8.5. Let U be in Sq{I1). Suppose that there exists J in N such that for every 
j > J the distribution UQ^^U is of the form fjm, where fj is a locally integrable function 
on Hn- Then for every N in N and every p in [1, oo] 

liminf II (1 + ^)-^/, C\^^)>piU). 

Proof. For the reader's convenience we write the proof although it follows the lines of that of 
Proposition 17.41 We may suppose that p{U) is positive, because in the case where p{U) = 0, 
there is nothing to prove. 

Let II (1 + A)~^ fj ||lp(h„) < oo. Suppose that < £ < p{U)/2 and let ifj be smooth 
function on M? with compact support in the set 

{(e,A)GM2 : p{U)-e<i<p{U)+e} 
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such that (f/, ^/')k2 ^ 0. For every nonnegative integer j, define a smooth function on 
with compact support by A) = "ipi^, A) for every A) in M^. Then for 1 < p < oo, 

< 11(1 + ^)-^/,||l.(h,o 11(1 + ^)^^"V,|JIl.'(h„) 

Let a be a positive integer such that ||(1 + ^)^~''\\lp'(h ) < ^5 then by Lemma EH] 



;i + ^)^^-V,iJIl.'(/^„) < ||(i + ^)^-1L.'(H„)ll(i + M+rV',llLi(E) 

2a 
s,r=l 



Therefore 



II (1 + ^)"^ /, iu.(H„) > I {u, 1 a,, r'^ (piu) - sY 

and the thesis follows. Similar considerations can be used in the case where p{U) = oo. □ 

Proposition 8.6. Let U he in Sq{I1) with p{U) < oo. Then Q^^U coincides with a smooth 
slowly growing function f on Hn and for every p in [1, oo] there exists h > such that 

hmsupjl il + A)-'L^f C{j,^^<p{U). 

Proof. Since p{U) < oo, the distribution U is compactly supported and therefore Q~^U 
coincides with the smooth function fjj on Hn by Lemma 18.11 and fu is slowly growing by 
Proposition 18.21 Moreover, the estimate (18. ip holds: if p > p{U) and k is the degree of U, 
there exists M such that for all j > 



\L^f{z,t)\<C{l+jyp^{l + \{z,t) 
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Let p in [1, oo] be fixed and choose h such that (1 + ^)-^+a^/2 jg jj^ LP{Hn)- Then for every 
P > P{U) 

II {l + A)-^Uf |U.(H,o < II {l+AY^^''/' |U.(^„) II {l+A)-''/'Uf |U.(H,o 

<c(i + j)V 

so that hmsupj^oo || (1 + A)~^ U f ||)>(//^^) < P, for every p > p{U). □ 

8.1. Square-integrable functions and Schwartz functions. Reasoning as in the proof 
of Theorem 17.61 and Corollary 17.71 it easy to prove the following characterization for square- 
integrable functions. 

Theorem 8.7. Let p > 0. Then Q is a bijection from the space 

{/ e LUH^) : hm II Uf \\'/,\ < p} 

onto the space 

{F G L2(S) : p(F) < p} . 

In the case of Schwartz functions, we obtain the following results. For F in we denote 
p(F) = p{Fp), so that 

p{F) = sup{e : A) 7^ and A) G S}. 

Proposition 8.8. Let 1 < p < oo and let F be in iS(S). Then for every h > 0, 

lim II il+A)'L^g~'F C\H„)=Pin 

Proof. Suppose < p{F) < oo. If 7 > is big enough so that (1 + A)~'^ is in L^{Hn) by 
Lemma [6.11 we obtain 

II {i + A)''vg~^F iu.(^„) < II (1 + ^)-^ |UnH„)ll (1 + ^)'+^ L^-^-iF|u.(H„) 
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< c f'+'^p{F)y . 

Hence 

limsup II (1 + A)' Ug-'F ||^//(^^) < p{F). 
and the thesis follows from Propostition 18.51 The cases p{F) = 0, oo are trivial. □ 

Theorem 8.9. Let F he in The following conditions are equivalent. 

(1) p{F) is finite; 

(2) for every h> and every p in [1, oo], limsupj^^o^ || L-'Q^^F \\]^J(^ff^^ is finite; 

(3) there exists p in [1, oo] such that lim inf j_j.oo || L^Q'^F \\^lpi^ij ) is finite. 
Moreover, if any of these conditions is satisfied, then for every h >0 and every p in [1, oo], 

lim II (l+A)' Ug~'F ||i//(^„)=p(F). 

Proof. The implication (1) ^ (2) follows by Propostion 18.81 The implication (2) ^ (3) is 
trivial. The implication (3) ^ (1) follows by Propostion 18.51 □ 
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